Language Modeling Is Compression
AK(@_akhaliq)
Language Modeling Is Compression
paper page: https://huggingface.co/papers/2309.10668
It has long been established that predictive models can be transformed into lossless compressors and vice versa. Incidentally, in recent years, the machine learning community has focused on training…
https://pbs.twimg.com/media/F6bvrnDXsAAJFkB.png
言語モデルで圧縮する